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John  E.  Walsh 
The  HaN2  Corporation 

1  In  practice  it  is  often  remissible  to  assume  that  the  observations 
of  a  set  are  statistically  independent  and  from  continuous  populations 
with  a  common  median.  Then  the  population  median  can  be  investigated  by 
using  the  sign  test.  For  small  numbers  of  observations,  however,  the 
sipn  test  does  not  furnish  very  many  suitable  sipnificance  levels.  Also, 
some  of  the  sipn  tests  with  suitable  sipnificance  levels  are  not  very 
efficient.  Thiff  note  presents  some  tests  whose  sipnificance  levels  are 
only  approximate  but  cover  a  wiae  range  of  suitable  values.  The  signifi¬ 
cance  levels  of  these  tests  are  exactly  determined  if  the  populations  are 
symmetrical;  they  are  bounded  otherwise.  Some  of  these  bounded  sipnifi¬ 
cance  level  tests  have  high  efficiencies.  >  t-r 

IhTUOuUCi'ION  nUu  S'iVTh^bNT  OF  uLSUU’S 

tor  practical  situations  involving  a  small  number  n  of  observations, 
it  is  frequently  permissible  to  assume  that 

(i).  The  observations  are  statistically  independent. 

(ii).  The  observations  are  from  continuous  populations. 

(iii).  The  populations  have  a  common  median  i. 

This  is  the  case,  for  example,  if  the  observations  are  a  sample  from  a 
continuous  population.  Then  the  sipn  test  can  oe  used  to  compare  i  with 
a  ,-iven  hypothetical  value 

Let  X| ,  ••.,  xn  denote  the  values  of  the  n  observations  arranged  in 
increasing  order  of  mapnitude.  Then  xt  •  value  of  smallest  observation, 
etc.  Th®  or  e-sided  sipn  test  of  4  <  4o  can  be  expressed  in  the  form 

( 1 )  accept  4  ^  io  i£  <  io  • 

The  sipnificance  level  of  this  test  has  the  value 


if  assumptions  (i)— (iii)  hold.  The  one-sided  test  of  t  >  4o  can  be 
defined  as 

n*1  —  i 


nccept  6  >  6c,,  if  x 


x  he  significance  level  ui  this  test  also  equals  (2)  wneri  ( i ) — (iii)  hold. 
The  eciual— tail  sign  test  of  ^  is  defined  by 


Accept  ^  II  either  x^^  ^  or  xii  +  1_.  >  ,  . 

where  i  >  (n+  1  )/2.  The  significance  level  of  this  test  equals  twice  the 
value  of  ( 2 )  when  (i)-(iii)  are  satisfied. 


The  sign  tests  are  easy  to  apply  anu  valid  under  very  general  condi¬ 
tions.  However,  for  small  values  of  n  (say,  n  <  10)  they  have  the  drawbacks 

(I).  Tor  given  n,  the  number  of  tests  with  suitable  significance 
levels  is  quite  limited. 

(11).  if  i  <  n,  the  efficiency  of  the  sign  test  is  not  very  great, 
hirst  consider  (I).  Kor  n  *  ID,  there  are  only  three  suitable  significance 
levels  (i.e.,  in  the  range  .001  — .07  for  one-sided  tests  or  in  the  ranre 
.002— .014  for  e~ual-tail  tests).  Moreover,  these  values  are  not  very  near 
each  other.  For  n  ^  10,  there  are  at  most  two  satisfactory  significance 
levels  for  riven  n,  and  these  are  not  very  close  together. 

Now  consiuer  (11).  If  i  =  n,  the  efficiency  is  approximately  (;5% 
lor  the  special  case  of  a  sample  from  a  normal  population  (unknown  standard 
deviation).  If  i  =  n  -  1 ,  this  efticiency  is  only  about  80%  and  drops 
further  to  anout  75%  if  i  a  n  -  2  (see  [l]).  accepting  the  efficiency  lor 
normality  as  an  indication  of  that  for  most  situations  of  a  practical 
nature,  the  ->i.  n  test  is  not  very  efficient  if  i  <  n. 

The  one-i i  ied  test  of  ^  <  %  presented  in  this  note  is 
(J)  accept  ^  <  4  if  max[xn.1f  i(xn  «■  xn  +  1-j)j  <  • 


If  the  condi  tion 

(iv).  The  populations  are  symmetrical . 
is  satisfied  in  audition  to  conditions  (i)-(iii),  the  significance  level 
for  test  (3)  is  j  ?p’n.  The  one-sided  test  of  ^  >  %  is 


accept  i  >  60  if 


min  j^Xa , 


Is  i 


> 


The  significance’  level  of  this  test  also  equals  j  ^  n  if  (i)— (iv)  hold. 
The  "symmetrical"  test  of  /  %  is 


jcce£t  6  +  if  either  rnax  Jx^  ,  ^xn  4  xn4l_^)j  m 
or  min|x^,  ^xi  ♦  x^)J  >  • 
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The  significance  level  of  this  test  has  the  value  ji  jj  when  conditions 
(i)-(iv)  are  satisfied. 

If  only  conditions  (i)-(iii)  are  necessarily  satisfied,  the  signifi¬ 
cance  levels  of  the  tests  presented  are  bounded  by  those  of  sign  tests. 
t or  example,  the  significance  levels  of  (1)  with  i  •  n  and  i  •  n  -  1  are 
lower  and  upper  bounce,  respectively,  for  test  (3)  when  only  (i)-(iii) 
need  hold. 

The  bounds  obtained  for  a  test  are  not  very  close  together.  Usually 
the  value  of  the  upper  bound  differs  froa  that  of  the  lower  bound  by  a 
factor  sonewhere  between  5  and  11.  It  should  be  reaer.tered,  however, 
that  the  upper  and  lower  liaits  represent  the  worst  that  can  happen; 
these  bounds  are  attained  only  for  the  most  extreme  types  of  situations. 
For  the  usual  run  of  practical  cases,  the  populations  tend  to  be  unimodal 
with  moderate  skewness.  For  these  situations,  the  significance  levels 
should  not  differ  appreciably  from  the  values  for  symmetry  (for  the 
bounded  significance  level  tests  of  this  paper).  It  seems  unlikely  that 
the  values  of  the  limits  will  be  approached  for  many  situations  of  prac¬ 
tical  interest  unless  the  significance  level  for  symmetry  is  already  near 
a  bound. 

Table  1  contains  a  list  of  the  tests  presented.  The  significance 
level  bounds  were  computed  under  the  assumption  that  only  (i)-(ill) 
necessarily  hold.  In  obtaining  the  significance  levels  listed,  it  wr.s 
assumed  that  (iv)  is  also  satisfied. 

ho  explicit  efficiency  investigation  was  carried  out  for  the  teste 
of  Table  1.  However,  the  results  of  [k}  indicate  that  the  efficiency  of 
a  test  is  reasonably  high  if  its  significance  level  (for  symmetry)  is  not 
near  the  upper  significance  level  bound,  as  an  example,  consider  the 
case  where  n  •  7.  The  one— sided  tests  with  significance  levels  .039, 
.031,  .023,  .016,  .L-OH  likely  have  fairly  high  efficiencies.  On  the 
other  hand,  the  one-sided  test  with  significance  level  .054  is  probably 
not  very  efficient.  «s  a  general  rule,  if  the  significance  level  of  a 
test  is  near  or  below  the  middle  of  the  range  of  possible  values  (l.e., 
the  point  halfway  between  the  bounds),  the  efficiency  of  the  test  can  be 
assumed  to  be  rather  high. 

anamination  of  Table  1  shows  that,  for  given  n,  several  of  the  tests 
may  have  the  sane  upper  and  lower  significance  level  bouncs,  even  though 
their  significance  levels  are  different.  For  example,  let  n  «  7.  The 
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one-sided  tests  with  listed  significance  levels  (for  symmetry)  .056,  .0 67, 
.039,  .031,  .0-0,  .Ul6  all  have  upper  bound  .062  and  lower  bound  .008. 

The  tests  of  Table  1  with  common  bounds  (n  fixed)  have  two  useful  proper¬ 
ties.  First,  the  significance  levels  (for  symmetry)  of  these  tests  rather 
thoroughly  cover  the  range  between  the  upper  limit  and  the  lower  limit. 
Second,  the  actual  significance  level  values  always  have  the  same  ordering 
as  that  for  the  case  of  symmetry.  As  an  illustration,  consider  a  case 
where  n  ■  8.  The  significance  level  of  the  test 

nccdpt  ^  <  ^0  II  max[x7,  ^x3  4  x8)J  <  ^0  • 

is  always  at  least  as  great  as  the  significance  level  for  the  test 

accept  l  <  if  iiiax[x7,  ^(x4  *  xd)"|  <  . 

This  is  a  direct  consequence  of  the  relation 

max  jx  7 ,  ^(x3  ♦  x8)]  <max[x7,  ^(x4  +  xu)j  . 

In  fact,  all  the  significance  level  orderings  follow  from  relations  of  this 
type. 

The  two  properties  are  helpful  in  deciding  which  test  of  Table  1  to 
apply  and  in  intuitively  justifying  its  use.  For  example,  let  n  «  7  and 
consider  one-sided  tests  of  ^  ,  the  desired  significance  level  being 

.U3.  ihen  the  t<-st  with  significance  level  .031  would  appear  suitable 
for  use.  The  existence  of  several  tests  with  significance  levels  neces¬ 
sarily  above  ana  necessarily  below  that  for  the  chosen  test  v.*oula  seem  to 
furnish  a  significance  level  "cushion.”  That  is,  if  the  significance 
level  for  the  chosen  test  approaches  one  of  the  bounds,  then  the  signifi¬ 
cance  levels  of  all  the  "intermediate”  tests  must  be  ”s<  ueezed”  into  a 
very  short  interval.  Examination  of  the  statistics  used  for  the  tests 
would  seem  to  indicate  that  such  a  "squeezing”  will  occur  only  for  extreme 
situations.  This  lead3  to  the  hope  that  the  significance  levels  nor  the 
tests  of  Table  1  will  usually  be  much  nearer  the  values  for  symmetry  than 
indicated  by  the  bounds. 

If  n  <  6,  even  use  of  Table  1  does  not  yield  very  many  tes^s  with 
suitable  significance  levels.  However,  the  tests  of  [j ,  Table  can  be 
used  to  partially  rlll  this  gap.  These  tests  have  bounded  significance 
levels  on  the  basis  of  (i)-(iii)  alone.  Table  2  lists  the  tests  of 
[3,  Table  2j  along  vitn  their  significance  level  bounds,  nil  of  these 
tests  can  be  assumed  to  have  high  efficiencies. 
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Use  of  the  tests  of  Table  1  with  high  efficiencies  is  indicated  even 
when  there  is  reason  to  believe  that  condition  (iv)  is  satisfied.  This 
procedure  furnishes  a  safety  factor  with  respect  to  violation  of  conoition 
(iv),  the  only  one  of  tr.e  four  conditions  not  readily  justifiable  on 
intuitive  grounds  alone  (ordinarily). 

The  significance  level  limits  for  the  tests  of  Tables  1  and  2  are 
obtained  by  finding  sign  tests  whose  significance  levels  bound  those  for 
the  given  tests.  Conditions  (i)-(iii)  are  sufficient  for  determining  the 
exact  significance  level  of  a  si*n  test  for  the  median.  Let  us  consider 
a  "symmetrical”  test  of  Table  1  or  Table  2.  The  upper  bound  of  the  signi¬ 
ficance  level  for  this  test  is  given  by  the  significance  level  of  an  equal- 
tail  sign  test.  Similarly  for  the  lower  bound  (if  a  lower  bound  is  listed 
for  the  test).  Thus  the  significance  level  limits  for  the  "symmetrical" 
tests  of  Tables  1  and  2  tend  to  remain  fixed  even  when  conditions  (ii)  and 
(iii)  are  violated.  This  follows  from  the  results  of  [4],  where  it  is 
shown  that  the  si  nificance  level  of  an  equal— tail  sign  test  tenas  to 
remain  about  the  same  under  extremely  general  conditions. 

KnfHEKnTICiiL  aN’aLYSIo 

This  section  contains  an  outline  of  the  methods  used  in  obtaining  the 
results  stated  in  the  preceding  sections. 

In  Table  1,  tne  significance  levels  for  the  case  where  all  of  (i)-(iv) 
hold  were  determined  by  use  of  Theorem  4  of  [2 J. 

In  Tables  1  and  2,  the  test  criteria  for  the  alternative  ^  ^  (i.e., 


ts  of 

the 

form :  Acc< 

ept  ^  < 

^0 

if  • • • . ) 

are 

of  the  types 

(a) 

xn 

A 

0 

(b) 

A*x 

n  *  B*xn-, 

0 

V 

( A* 

♦  B* 

-  1) 

(c) 

C^x 

n  ~  D'x'  < 

^0  » 

(C* 

- 

-  1) 

(d) 

max 

[xn— 1  ’  h(x 

1 »  •  •• » 

xn 

A 

XSs. 

c 

Mx,  ,  •  •  • ,  xn)  <  xn  . 

Let  us  examine  each  of  these  four  cases. 

horm  (a)  represents  a  sign  test  itself  (i.e.,  nccept  6  <  6^  if  x_  <  . 

1  \n  n 

is  a  sign  test).  The  significance  level  of  this  sign  test  is  [jj  . 

Now  consider  case  (b)  .  Since 

xn  2  A‘xn  *  3‘x»-1  ^  x 


Ii— 1  » 
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it  follows  that 

Pr(xn  ^0)  <  Pr{h^xr]  ♦  <  40)  <  Pr(xR_1  <  ) . 

This  relation  gives  upper  and  lower  significance  level  limits  in  terms  of 
sign  tests.  The  significance  level  for  the  sign  test  based  on  xn_^  < 

is  (n  ♦  1  )(^)n. 

Case  (c)  was  analyzed  in  [5]  and  the  reasoning  will  not  be  repeated 
aere.  The  relation  obtained  is 

Pr(C*xn  -  D*x,  <  to)  <  Pr(xn  <  i0) . 

Finally,  let  us  consider  form  (d).  Since 

rn**[*nH»  h(x«*  *“»  xn}J  -  xn  » 

it  follows  that 

Pr(xn  <  ^0)  <  Pr{max [xn-l »  h(x»»  *•*»  xnJ]  <  **oJ>  • 

rtlso  , 

Pr|max[xnH,  h(x,  ,  •••,  xn)]  <  rf0}  *  Pr[xn-i  <  A)»  h<xi  .  **•»  *n)  <  rfo] 

<  Pr(xnH  <  tQ)  . 

This  establishes  upper  and  lower  significance  level  limits  in  terms  of  the 
significance  levels  of  sign  tests. 

The  results  for  the  corresponding  one-3iaed  tests  of  are 

obtained  by  obvious  modifications  of  the  analysis  given  above.  The  results 
for  "symmetrical"  tests  of  are  a  direct  consecuence  of  the  non- 

overlapping  property  of  the  two  one-sided  tests  combined  to  form  asymmet¬ 
rical"  test*. 
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TESTS 

•SYMMETRICAL":  Accept  4  4  4Q  if  either 


■Symmet¬ 

rical" 


.125 


.062  .125 


.031  .062 


.062  .125 


.047  .094 


.031  .062 


.016  .032 


.054  .108 


.047  .094 


.039  .078 


.031  .062 


.023  .047 


.016  .032 


.008  .016 


.031  .062 


.027  .054 


.023  .047 


.020  .040 


.016  .032 


.012  .023 


.016 


•004  i  .008 


ONE-SIDED: 

Accept  4  <  40  If 


x.  <  4 

g.  r  r\ 


[x  ,  JU4*x6)j  <4e 


x6  < 


raax[x6, 


max[x6, 


max[x6, 


max[x6,  $x+x7)]<4c 


■“[V  2(  VX8}1  < 


ONE-SIDED: 
Accept  ^  if 


xl>'fo 


2(xl  *  *2>  >  "*o 


min[x2>  ?<V*J  > 


oln[x2»  3<Vx1>]  '•  *c 


2**1  *  x2>  >  *0 


"“[*7*  |(Xj*x8)]  <  i0  min  [x2,  ftx^)]  >  ^ 


■“[*7»  ^VVj  “lnLx2>  2(xl*x3)j  >*. 


Significance  Level  Bounds 
for  Conditions  (i)— (iii) 


One-sided  "Symmetrical* 


Upper  Lowe 


«in[x2,  ^vV]  >*o  ! 

- - - j - = 

min[x2,  f(x1^x6) 

a^n[x2’  i(xl*x5> 

\>*o 

min  [*2* 

>K 

min[x2, 

i(Xi  ♦  Xj)  > 

\>*o 

“Hv  l(xi4xsi 

>4 

r0 

minjxj,  |(x1^x7) 

>4 

ro 

min  [*2» 

>4 

r0 

x8  < 


*l>*c 


.125 

.125 

.374 

.062 

.062 

.062 

.218 

.032 

.032 

.032 

.125 

.016 

.016 

.016 

.070 

.008 

.008 

.008 

TAOLE  1  (cont'd) 
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n 

tests 

•  SYMMETRICAL"  :  Accept  4  4  4  if  either 

Significance  Level  Pour.  1 
for  Conditions  (i)—  (ill 

•JR0H 

One-sided 

•Synrietrl  ra 

1 

■Symmet¬ 

rical" 

ONE-SIDED: 

Accept  4  <  40  If 

0 ‘IE-SIDED: 

Accept  4  '•  f^0  if 

Upper 

lower 

Upi^r 

D 

9 

.018 

.035 

E"- ^  E2C  • !  Vi  r *  E 

min[x2,  >^Q 

.020 

.002 

.040 

.  ^4 

.016 

.032 

n.«[xg,  |<x2.x9)]  . 

min[x2,  |(x1*xg)|  >  4q 

.014 

.027 

B^CT 

min[x2,  ^x^x^j  >4Q 

.012 

.023 

rnin[x2»  >*0 

.010 

.020 

min[x2,  ^♦x^]  >4q 

.008 

.016 

max  [xs*  iKvVl  •  K 

min[x2,  |<VVJ  >4q 

.006 

.012 

mx  Xg,  §{x7*x9)J  <  4q 

ain|*2#  |(x1+x3)  ‘  >4q 

.004 

.008 

§<*1  *  x2)  >  *0 

.002 

.004 

V  -  K 

*1 >  4> 

.002 

.002 

.004 

.  X)4 

10 

m 

.020 

min[x2,  |(»14x10)]  >  4q 

.011 

.001 

.022 

.  v  02 

.009 

.018 

rainjx2,  |(x1*x9)j  >  iQ 

.008 

.016 

“*[*9*  |(*3**io)]  < 

.0C7 

.014 

maxfx,,  |(x4*x10)  |  <  40 

.  CC  6 

.012 

max  [x9,  ^(x5*Xi0)  |  <  4q 

min[x2’  §<  VV]  11  *o 

.005 

.010 

max  LV  f(  V^J  <  K 

min[x2,  §(x14X5)j  >4q 

.004 

.008 

maxrx9,  |(xy*x10)]  <  4Q 

EEB3EE39QQ3li 

.003 

.006 

““[v  j(xs.x10)]  <  *Q 

mln[x2, 

.002 

.004 

§(*1  *  x2)  > 

.001 

.002 

* 

o 

A 

O 

*1  '■  *o 

.001 

.001 

.002 

.002 

Significance  Level  Bourvi  s  for  the  Tests  o 
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